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Abstract 

Despite of the extreme success of the spectral graph theory, there are relatively few 
papers applying spectral analysis to hypergraphs. Chung first introduced Laplacians for 
regular hypergraphs and showed some useful applications. Other researchers treated 
hypergraphs as weighted graphs and then studied the Laplacians of the correspond- 
ing weighted graphs. In this paper, we aim to unify these very different versions of 
Laplacians for hypergraphs. We introduce a set of Laplacians for hypergraphs through 
studying high-ordered random walks on hypergraphs. We prove the eigenvalues of these 
Laplacians can effectively control the mixing rate of high-ordered random walks, the 
generalized distances/diameters, and the edge expansions. 

1 Introduction 

Many complex networks have richer structures than graphs can have. Inherently they have 
hypergraph structures: interconnections often cross multiple nodes. Treating these networks 
as graphs causes a loss of some structures. Nonetheless, it is still popular to use graph 
tools to study these networks; one of them is the Laplacian spectrum. Let G be a graph 
on n vertices. The Laplacian C of G is the (n x n)-matrix I — T~ 1/>2 AT~ 1 / 2 , where A 
is the adjacency matrix and T is the diagonal matrix of degrees. Let Ao, Ai, . . . , A n _i be 
the eigenvalues of C, indexed in non-decreasing order. It is known that < A; < 2 for 
< i < n — 1. If G is connected, then Ai > 0. The first nonzero Laplacian eigenvalue Ai 
is related to many graph parameters, such as the mixing rate of random walks, the graph 
diameter, the neighborhood expansion, the Cheeger constant, the isoperimetric inequalities, 
expander graphs, quasi-random graphs, etc [H [21 El El E] - 

In this paper, we define a set of Laplacians for hypergraphs. Laplacians for regular 
hypergraphs was first introduced by Chung [4j in 1993 using homology approach. The first 
nonzero Laplacian eigenvalue can be used to derive several useful isoperimetric inequalities. 
It seems hard to extend Chung's definition to general hypergraphs. Other researchers treated 
a hypergraph as a multi-edge graph and then defined its Laplacian to be the Laplacian of the 
corresponding multi-edge graph. For example, Rodriguez [5] showed that the approach above 
had some applications to bisections, the average minimal cut, the isoperimetric number, the 
max-cut, the independence number, the diameter etc. 

What are "right" Laplacians for hypergraphs? To answer this question, let us recall 
how the Laplacian was introduced in the graph theory. One of the approaches is using 
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geometric/homological analogue, where the Laplacian is defined as a self-joint operator on 
the functions over vertices. Another approach is using random walks, where the Laplacian 
is the symmetrization of the transition matrix of the random walk on a graph. Chung [3] 
took the first approach and defined her Laplacians for regular hypergraphs. In this paper, 
we take the second approach and define the Laplacians through high-ordered random walks 
on hypergraphs. 

A high-ordered walk on a hypergraph H can be roughly viewed as a sequence of over- 
lapped oriented edges F\ , Fi , . . . , F). . For 1 < s < r — 1, we say Fi , F2, . . . , F^ is an s-walk 
if \Fi H Fi + i I = s for each i in {1, 2, 3, . . . , k — 1}. The choice of s enables us to define a set 
of Laplacian matrices for H. For s = 1, our definition of Laplacian £W is the same as 
the definition in [9]. For s = r — 1, while we restrict to regular hypergraphs, our definition 
of Laplacian £( r_1 ) is similar to Chung's definition [4]. We will discuss their relations in the 
last section. 

In this paper, we show several applications of the Laplacians of hypergraphs, such as 
the mixing rate of high-ordered random walks, the generalized diameters, and the edge 
expansions. Our approach allows users to select a "right" Laplacian to fit their special need. 

The rest of the paper is organized as follows. In section 2, we review and prove some useful 
results on the Laplacians of weighted graphs and Eulerian directed graphs. The definition 
of Laplacians for hypergraphs will be given in section 3. We will prove some properties of 
the Laplacians of hypergraphs in section 4, and consider several applications in section 5. In 
last section, we will comment on future directions. 

2 Preliminary results 

In this section, we review some results on Laplacians of weighted graphs and Eulerian directed 
graphs. Those results will be applied to the Laplacians of hypergraphs later on. 

In this paper, we frequently switch domains from hypergraphs to weighted (undirected) 
graphs, and/or to directed graphs. To reduce confusion, we use the following conventions 
through this paper. We denote a weighted graph by G, a directed graph by D, and a 
hypergraph by H. The set of vertices is denoted by V(G), V{D), and V(H), respectively. 
(Whenever it is clear under the context, we will write it as V for short.) The edge set is 
denoted by E(G), E(D), and E(H), respectively. The degrees and volumes vol(*) are 
defined separately for the weighted graph G, for the directed graph D, and for the hypergraph 
H. Readers are warned to interpret them carefully under the context. 

For a positive integer s and a vertex set V, let V- be the set of all (ordered) s-tuples 
consisting of s distinct elements in V. Let ( v ) be the set of all unordered (distinct) s-subset 
of V. 

Let 1 be the row (or the column) vector with all entries of value 1 and / be the identity 
matrix. For a row (or column) vector /, the norm ||/|| is always the L2-norm of /. 

2.1 Laplacians of weighted graphs 

A weighted graph G on the vertex set V is an undirected graph associated with a weight 
function w: V x V R-° satisfying w(u,v) — w(v,u) for all u and v in V{G). Here we 
always assume w(v , v ) = for every v G V. 

A simple graph can be viewed as a special weighted graph with weight 1 on all edges 
and otherwise. Many concepts of simple graphs are naturally generalized to weighted 
graphs. If w(u, v) > 0, then u and v are adjacent, written as x ~ y. The graph distance 
d(u, v) between two vertices u and v in G is the minimum integer k such that there is a path 
u = Vo, v±, . . . , Vk = v in which w(vi-i, Vi) > for 1 < i < k. If no such k exists, then we let 
d(u,v) — 00. If the distance d(u,v) is finite for every pair (u,f), then G is connected. For 
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a connected weighted graph G, the diameter (denoted by diam(G)) is the smallest value of 
d(u,v) among all pairs of vertices (u, v). 

The adjacency matrix A of G is defined as the matrix of weights, i.e., A{x, y) = w(x, y) 
for all x and y in V. The degree d x of a vertex x is w(x, y). Let T be the diagonal matrix 
of degrees in G. The Laplacian C is the matrix I — P -1 / 2 AT^ 1 / 2 . Let Ao, Ai, . . . , A n _i be 
the eigenvalues of C, indexed in the non-decreasing order. It is known [5J that < A, < 2 
for < i < n — 1. If G is connected, then Ai > 0. 

From now on, we assume G is connected. The first non-trivial Laplacian eigenvalue Ai is 
the most useful one. It can be written in terms of the Rayleigh quotient as follows (see [5J) 

A l = lllf ^ 77 xo j ■ (1) 

Here the infimum is taken over all functions / : V — > K which is orthogonal to the degree 
vector IT = [dx, d 2 , . . . , d n ). Similarly, the largest Laplacian eigenvalue A n _i can be defined 
in terms of the Rayleigh quotient as follows 

Ex-yC/OO - /(i/))Ms>tf) 

A n _i = sup — . 2 

f-LTl T, x f( X ) d x 

Note that scaling the weights by a constant factor will not affect the Laplacian. A 
weighted graph G is complete if w(u, v) = c for some constant c such that c > 0, independent 
of the choice of (u, v) with u ^ v. We say G is bipartite if there is a partition V = L U P 
such that w(x, y) = for all x,y £ L and all x,y £ R. 

We have the following facts (see [B]). 

1. < Ai < 2 for each < i < n - 1. 

2. The number of eigenvalues equals the number of connected components in G. If G 
is connected, then Ai > 0. 

3. A„_i = 2 if and only if G has a connected component which is a bipartite weighted 
subgraph. 

4. A„_i = Ai if and only if G is a complete weighted graph. 

It turns out that Ai and X n -i are related to many graph parameters, such as the mixing 
rate of random walks, the diameter, the edge expansions, and the isoperimetric inequalities. 

A random walk on a weighted graph G is a sequence of vertices vq,V\, . . . ,Vk such that 
the conditional probability Pr(t>i + i = v \ Vi — u) — w(u,v)/d u for < i < k — 1. A 
vertex probability distribution is a map /: V — > R such that f(y) > for each v in G and 
Euev = It i s convenient to write a vertex probability distribution into a row vector. 
A random walk maps a vertex probability distribution to a vertex probability distribution 
through multiplying from right a transition matrix P, where P(u,v) = w(u,v)/d u for each 
pair of vertices u and v. We can write P — T~ X A = T _1 / 2 (7 — £)T X / 2 . The second largest 
eigenvalue A(P), denoted by A for short, is max{|l — Ai|, |1 — A„_i|}. Let tt(u) = d u /vo\(G) 
for each vertex u in G. Observe 7r is the stationary distribution of the random walk, i.e., 
7rP = 7r. A random walk is mixing if lim^oo/oP* = 7r for any initial vertex probability 
distribution f$. It is known that a random walk is always mixing if G is connected and not 
a bipartite graph. To overcome the difficulty resulted from being a bipartite graph (where 
A„_x = 2), for < a < 1, we consider an a-lazy random walk, whose transition matrix P a is 
given by P Q (it, u) = a for each u and P a (u, v) = (1 — a)ui(it, v)/d u for each pair of vertices 
it and v with «/». Note that the transition matrix is 



P a =al+(1- a)T- 1 A = T- 1 / 2 ^ - (1 - a)C)T 



1/2 
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Let L a = T^PaT- 1 / 2 = I- (1 - a)C and \ a = max{|l 
Since L a is a symmetric matrix, we have 



Aq, = max — — r 



(l-a)Ai|,|l- (l-a)A„_i|}. 



It turns out that the mixing rate of an a-lazy random walk is determined by A Q . 

Theorem 1 For < a < 1, i/ie vertex probability distribution fk of the a-lazy random walk 
at time k converges to the stationary distribution tt in probability. In particular, we have 

\\(f k ^7T)T-^ 2 \\<X k \\(f ~7r)T^ 2 \\. 

Here fo is the initial vertex probability distribution. 

Proof: Notice that f k = / P* and (/ - n)^ 1 / 2 _L IT 1 / 2 . We have 

II(/*-t)t- 1/2 II = \\ihP k a -*P k a )T- 1/2 \\ 

= IK/o-^T-V^H 

< A^IK/o -7r)2— V2||. □ 

For each subset X of V(G), the volume vol(X) is J2 x ex ^x- li X — V{G), then we write 
vol(G) instead of vol(V(G)). We have 

n 

vol(G) = d i = 2 w ( u > w )- 

If X is the complement set of X, then have vol(X) = vol(G) — vol(X). For any two subsets 
X and Y of V(G), the distance d(X, Y) between X and Y is min{d(x, y) : x £ X,y E Y}. 



Theorem 2 (See pH [6]) In a weighted graph G, for X, Y C T^(G) mi/i distance at least 2, 
we have 

log. 



vol(X)vol(r) 
vol(X)vol(r) 



log 



, A„-i+Ai 



A special case of Theorem [5] is that both X and V are single vertices, which gives an 
upper bound on the diameter of G. 

Corollary 1 (See |6j) If G is not a complete weighted graph, then we have 

"log(vol(G)/£)~ 



diam(G) < 



log 



A„_i+Ai 



where 8 is the minimum degree of G. 

For X, Y C F(G), let B(X, Y) be the set of edges between X and Y\ Namely, we have 
E(X, Y) = {(u, v) : u e X, v e Y and uv € E(G)}. 
We have the following theorem. 
Theorem 3 (See [HIEI) If X and Y are two subsets ofV(G), then we have 

vo\(X)vo\(Y) 



\E(X,Y)\- 



vol(G) 



< A 



v /vol(X)vol(y)vol(X)vol(F) 
vol(G) ' 
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2.2 Laplacians of Eulerian directed graphs 

The Laplacian of a general directed graph was introduced by Chung [7J |S] ■ The theory is 
considerably more complicated than the one for undirected graphs, but when we consider a 
special class of directed graphs — Eulerian directed graphs, it turns out to be quite neat. 

Let I? be a directed graph with the vertex set V(D) and the edge set E(D). A directed 
edge from x to y is denoted by an ordered pair (x, y) or x — > y. The out-neighborhood 
F + (x) of a vertex a; in I? is the set {y: (x,y) G E(D)}. The out-degree d x is |r + (a;)|. 
Similarly, the in-neighborhood r _ (x) is {y: {y,x) £ E(D)}, and the in-degree d~ is |r~(x)|. 
A directed graph D is Eulerian if d x = d~ for every vertex x. In this case, we simply write 
d x = d x ' = d~ for each x. For a vertex subset S, the volume of S, denoted by vol(S'), is 
J2xes dx- In particular, we write vol(D) = J2 x ev dx- 

Eulerian directed graphs have many good properties. For example, a Eulerian directed 
graph is strongly connected if and only if it is weakly connected. 

The adjacency matrix of D is a square matrix A satisfying A(x, y) = 1 if (x, y) G E(D) 
and otherwise. Let T be the diagonal matrix with T(x,x) — d x for each x € V(D). Let 
£= I -T-^AT- 1 / 2 , i.e., 

1 if x = y; 

%*>v) = { -^h: {ix ^ m ( 3 ) 

otherwise. 

Note that C is not symmetric. We define the Laplacian C of D to be the symmetrization 
of £, that is 

£ + £' 
C = — 

Since C is symmetric, its eigenvalues are real and can be listed as Ao, Aj., . . . , \ n -i in the 
non-decreasing order. Note that Ai can also be written in terms of Raleigh quotient (see [7]) 
as follows 

. . . E^ y (.f(x)-f(y)) 2 ... 

Xl = f^ 2 L/W ■ (4) 

Chung 8 proved a general theorem on the relationship between Ai and the diameter. 
After restricting to Eulerian directed graphs, it can be stated as follows. 

Theorem 4 (See |8j) Suppose D is a connected Eulerian directed graph, then the diameter 
of D (denoted by diam(D)) satisfies 



diam(D) < 



21og(vol(G , )/£) 
log 



2-Ai 



where Ai is the first non-trivial eigenvalue of the Laplacian, and S is the minimum degree 
min{d x | x G V(D)}. 

The main idea in the proof of the theorem above is using a-lazy random walks on D. 
A random walk on a Eulerian directed graph D is a sequence of vertices vq, Vi , . . . , Vk such 
that for < i < k— 1, the conditional probability Pr(«i + i = v \ Vi = u) equals l/d u for each 
v G r + (u) and otherwise. For < a < 1, the a-lazy random walk is defined similarly. The 
transition matrix P a of the a-lazy random walk satisfies 



P a =aJ + (l- a)T- l A = T-^ 2 {I - (1 - a)C)T 



1/2 
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Chung [7] considered only 1/2-lazy random walks. Here we prove some results on a-lazy 
random walks for a G [0, 1). 

Let 7r(u) = d u /~vo\(D) for each u £ V(D). Note that it is the stationary distribution, 
i.e. irP a = 7T. Let L a = al + (1 - a)^ 1 ' 2 AT' 1 ' 2 = I - (1 - a)£ = T 1 / 2 P Q T -1 / 2 . The 
key observation is that there is a unit-vector <fio such that </>o is both a row eigenvector and 
a column eigenvector of L a for the largest eigenvalue 1. Here let c/) — IT 1 / 2 /vo\(D) = 
^G)(V<k, • • • , \/<4)- We have 

</> L Q = 0o and L a <j)' = </>' . 

Let <^>q" be the orthogonal complement of <po in R n . It is easy to check L a maps <f)Q to t^. 
Let cr Q be the spectral norm of L a when restricting to (j>Q . An equivalent definition of o~ a is 
the second largest singular value of L a , i.e., 

IIWII 
a a = max . 



Lemma 1 FFe have the following properties for o~ a . 

1. For every ft £ cf>Q , we have \\L a f3\\ < cx a ||/3||. 

2. (1- Ai) 2 < a 2 < 1. 

3. a 2 a <a 2 + 2a(l - a)Ai + (1 - a) 2 a 2 . 

Proof: Item 1 is from the definition of a a . Since the largest eigenvalue of L a is 1, we have 
a a < 1. In particular, a 2 < 1. Note that L = T~ x l 2 AT^ 1 ! 2 . Let / = gT 1 ' 2 . It follows that 

\\Lof\\ 2 g'A'T~ 1 Ag 
a = SU P || f ..a = SU P 77f ■ 

f±4>' 11/ II s-LTi g'Tg 

Choose g £ (T 1 !)^ such that the Raleigh quotient (|4]) reaches its minimum at g, i.e., 



Ai 



E^ y (g(x) - g(y)) 2 



We have 

g'A'T^Ag 37 foer+Or) 9{v) 



g'Tg J2 X d x g{x) 2 

J2 X d x g{x) 2 J2 X £ (E y er+( X ) 9{v) 



> 



(E x d x g(x) 2 ) 
(E x g(x)E y& r+( X )9(y) 

(E x d x g(x) 2 ) 2 
f T, x g(x)T, v er+( x )9(y) \ 

{ E x d x g(x) 2 ) 

(1-Ai) 2 . 
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In the last step, we use the following argument. 

EjW£ jer+M gfe) _ (g(x) 2 + g(y) 2 -(g(x)-9(y)) 2 ) 

Y. x d xg{x) 2 Y. x d xg{x) 2 

E x ^ y (g(x)-g(y)) 2 

^ x d x g{xf 

= 1-Al 

Since <7o is the maximum over all g _L XT, we get (1 — Ai) 2 < <Jq. 
For item 3, we have 



<7 2 = sup 



\L a f\ 



2 



sup 



gxri g'Tg 

2 g'(A + A')g 2 g'A'T-^Ag 

< a + a(l — a) sup — h (1 — a) sup 



gXTl 5T.g gXTl 



a 2 + 2a(l-a)(l-A 1 ) + (l-a) 2 crg. □ 



Theorem 5 For < a < 1, the vertex probability distribution //. of the a-lazy random 
walk on a Eulerian directed graph D at time k converges to the stationary distribution tt in 
probability. In particular, we have 

Ufk-^T-^W^aiUfo-^T-^l 

Here /o is the initial vertex probability distribution. 

The proof is omitted since it is very similar to the proof of Theorem [1] Notice that when 
< a < 1, we have o~ a < 1 by Lemma U We have the a-lazy random converges to the 
stationary distribution exponentially fast. 

For two vertex subsets X and Y of V(D), let E(X, Y) be the number of directed edges 
from X to Y, i.e., E(X 1 Y) = {(u, v) : u <G X and v € Y}. We have the following theorem 
on the edge expansions in Eulerian directed graphs. 

Theorem 6 If X and Y are two subsets of the vertex set V of a Eulerian directed graph D, 
then we have 



\E(X,Y)\- vol (*)vol(Y) 



vol(D) 



- v /vol(X)vol(y)vol(X)vol(y) 

- ff0 ™kd) ' 



Proof: Let lx be the indicator variable of X, i.e., lx(u) = 1 if u € X and otherwise. 
We define ly similarly. Assume ljfT 1 / 2 = ao0o + ai0i and lyT 1 / 2 = oo0o + &102, where 
0i, 02 € 0o and are unit vectors. Since 0o is a unit vector, we have 

a = (IxT ' ,0 O ) = , (5) 
Vvol(D) 

and 

al+a\ = (lxT 1 / 2 , lxT 1 / 2 ) = vol(X). (6) 

Thus 



ai = Jvol(X)vol(X)/vol(Z>). (7) 
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Similarly, we get 



It follows that 



\E(X,Y)\ 



b = 

h = 

vol(X)vol(Y) 



vol(y) 



vol(F)vol(F)/vol(L>). 



(8) 
(9) 



vol(L>) 



= |(a o o + ai0i)(L o - 0o 0o ) (fro ^0 + &102)'| 

= \aih<f>iL <f)' 2 \ 

< |ai6i|||0i||||L o 0^|| 

< |ai6i|cro 



- v /vol(X)vol(y)vol(X)vol(y) 
vol(D) ' 



The proof of this theorem is completed. 



□ 



If we use A instead of o~o, then we get a weaker theorem on the edge expansions. The 
proof will be omitted since it is very similar to the proof of Theorem [5] 

Theorem 7 Let D be a Eulerian directed graph. If X and Y are two subsets ofV(D), then 
we have 



\E(X,Y)\ + \E(Y,X)\ vol(X)vol(Y) 



vol(D) 



< A 



-v/vol(X)vol(Y)vol(X)vol(y) 
vol(D) ' 



For X,Y C V(D), let d(X, Y) = min{d(u, v) : u e X and v e Y}. We have the following 
upper bound on d(X, Y). 

Theorem 8 Suppose D is a connected Eulerian directed graph. For X, Y C V(D) and 
< a < 1, we have 



d(X,Y) < 



log 



vol(X)vol(y) 
vol(X)vol(Y) 



log a a 

In particular, for < a < 1, the diameter of D satisfies 

-io g (voi(i>)/a) 



i. 



diam(D) < 



log a a 



where 5 = min{d x : X £ V}. 
Remark: From lemma [TJ we have 

o-l < a 2 + 2a(l - a)A x + (1 - afa^. 

We can choose a to minimize o~ a . If Ai < 1 — o~q, then we choose a = and get a a = o~o; 

if Ai > 1 — Cq) then we choose a = 2\^+o^-i ano - & et CT a — 1 — 2\ 1 + 1 a 2 -i ■ Combining two 
cases, we have 

f cr if Ai < 1 - a 2 ; 

(10) 



min {aa] < 

0<Q<1 



2Ai+<r^-l 



otherwise. 
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It is easy to check 



min {a a } < 
0<a<l V 2 



Here the inequality is strict if Co < 1- We have 

vol 

vol(X)vol(y) 



d(X, Y) < 



1q ™l(X)vol(F) 



log 



2-Ai 



1. 



Theorem [5] is stronger than Theorem U in general. 

Proof: Similar to the proof of Theorem [51 let lx and ly be the indicator functions of 
X and Y, respectively. We have 

lxT 1 ' 2 

lyT 1 / 2 



bo + aipi, 
b (j)o + hfc, 



where 4>i,<f>2 € <t>a and are unit vectors and oo, bo, a\, b\ are given by equations (JS])-©. 
Let k 



ln _. , / v..l( A- )v,.l< VI 

lQ S V voi(x)voi(y) 



1. We have 



(IxT'/^LKIyT 1 / 2 )' > a b + a^aih > 0. 

Thus there is a directed path starting from some vertex in X and ending at some vertex 
in Y, that is d(X, Y) < k. 

For the diameter result, we choose X = {x} and Y = {y}. Note that vol(X) = d x > S, 
vol(y) = d y > 5, vol(X) < vol(G), and vol(y) < vol(G). The result follows. □ 



3 Definition of the s-th Laplacian 



Let H be an r-uniform hypergraph with the vertex set V(H) (or V for short) and the edge 
set E{H). We assume \V{H)\ = n and E{H) C (^). For a vertex subset S such that 151 < r, 
the neighborhood T(S) is {T\SC\T = and S U T is an edge in H}. Let the degree d s of S 
in H be the number of edges containing S, i.e, d s — |r(5)|. For 1 < s < r — 1, an s-walk of 
length k is a sequence of vertices 

Vi, v 2 , ■ ■ ■ , Vj, . . . , W( r _ s )( fc _i) +r 

together with a sequence of edges Fi , F2 , ■ . ■ , Fk such that 

F t = {W( r _ s )(i_i) + i, «( r _ s )(i_i) + 2, • • • , U( r _ s )(t_l)+ r } 

for 1 < i < fc. Here are some examples of s- walks as shown in Figure [T] 





















v 6 


v 1 


v 2 


V 3 




v 4 


v 5 



V. V 5 V, 



A 1-walk in a 3-graph A 2-walk in a 3-graph A 2-walk in a 4-graph 

Figure 1: Three examples on an s-walk in a hypergraph 

For each i in {0,1,..., k}, the i-f/i stop Xi of the s-walk is the ordered s-tuple 
(vr r _ s \i + i , W( r _ s )j +2 , . . . , U( r _ s )i_)_ s ). The initial stop is a?o, and the terminal stop is Xk- An 
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s-walk is called an s-path if every stop (as an ordered s-tuple) is different from each other. 
If xo = Xk, then an s-walk is closed. An s-cycle is a closed s-path. 

For 1 < s < r — 1 and x, y £ V-, the s-distance d^ s \x,y) is the minimum integer k such 
that there exists an s-path of length k starting from x and ending at y. A hypergraph H is 
s-connected if (x, y) is finite for every pair (x, y). If H is s-connected, then the s-diameter 
of H is the maximum value of d^ s ' (x, y) for x, y £ V— . 

A random s-walk with initial stop x is an s-walk generated as follows. Let xq be the 
sequence of visited vertices at initial step. At each step, let S be the set of last s vertices in 
the sequence of visited vertices. A random (r — s)-set T is chosen from T(S) uniformly; the 
vertex in T is added into the sequence one by one in an arbitrary order. 

For < a < 1, an a- lazy random s-walk is a modified random s-walk such that with 
probability a, one can stay at the current stop; with probability 1 — a, append r — s vertices 
to the sequence as selected in a random s-walk. 

For x £ V-, let [x] be the s-set consisting of the coordinates of x. 

3.1 Case 1 < s < r/2 

For l<s<r/2, we define a weighted undirected graph C?w over the vertex set V- as 
follows. Let the weight w{x,y) be \{F £ E(H) : [x] U [y] C F}\. Here [x] U [y] is the disjoint 
union of [x] and [y]. In particular, if [x] H [y] ^ 0, then w(x, y) = 0. 
For x £ V-, the degree of x in G {s \ denoted by , is given by 

y ^ ' 

Here d\ x \ means the degree of the set [x] in the hypergraph H . When we restrict an s-walk 
on H to its stops, we get a walk on . This restriction keeps the length of the walk. 
Therefore, the s-distance d^ (x, y) in H is simply the graph distance between x and y in 
G' S J ; the s-diameter of H is simply the diameter of the graph . 

A random s-walk on H is essentially a random walk on G^ s \ It can be constructed 
from a random walk on G^ s ' by inserting additional random r — 2s vertices Ti between two 
consecutive stops Xi and Xi+x at time i, where Ti is chosen uniformly from r([xj] U [xj+i]) 
and inserted between x% and Xi+i in an arbitrary order. 

Therefore, we define the s-th Laplacian of H to be the Laplacian of the weighted 
undirected graph G^ . 

The eigenvalues of are listed as , , . . . , A/*l , in the non-decreasing order. Let 

AmL = A/* I , and — max{|l — A^ |, |1 — Amax|}- For some hypergraphs, the numerical 
values of A^ and Amax are shown in Table [T] at the end of this section. 

3.2 The case r/2 < s < r - 1 

For r/2 < s < r — 1, we define a directed graph over the vertex set V- as follows. For 
.x, y £ V- such that x = (x\, . . . , x s ) and y = (y±, . . . , y s ), let (x, y) be a directed edge if 
x-r-s+j = Vj for 1 < j < 2s — r and [x] U [y] is an edge of H. 

For x £ V-, the out-degree c?+ in and the in-dcgrce d~ in satisfy 

d+ = d [x] (r-s)\ = d~. 

Thus is a Eulerian directed graph. We write di^ for both d+ and d x . Now is 
strongly connected if and only if it is weakly connected. 
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Note that an s-walk on H can be naturally viewed as a walk on Z)( s > and vice versa. 
Thus the s-distance d^ s ' (x, y) in H is exactly the directed distance from x to y in G^; the 
s-diameter of H is the diameter of . A random s-walk on H is one-to-one corresponding 
to a random walk on D^ S K 

For ? < s < r — 1, we define the s-th Laplacian £( s ) as the Laplacian of the Eulerian 
directed graph (see section 2). 

The eigenvalues of are listed as Aq , A^ , . . . , A/„% t in the non-decreasing order. Let 

Amax = Afel | and A^ = max{|l — A^ |, |1 — Aml x |}. For some hypergraphs, the numerical 
values of A^ and Amax are shown in Table [T] at the end of this section. 

3.3 Examples 

Let be the complete r-uniform hypergraph on n vertices. Here we compute the values of 
Ai and Amax for some K r n (see Table [T]). 



H 


A< 4 > 


A* 3 * 




A^ 


A (1) 

A max 


X (2) 


X (3) 
^max 


\(4) 
^max 








3/4 


6/5 


6/5 


3/2 












7/10 


7/6 


7/6 


3/2 










1/3 


5/6 


6/5 


6/5 


3/2 


1.76759 








3/8 


9/10 


7/6 


7/6 


7/5 


7/4 






0.1464 


1/2 


5/6 


6/5 


6/5 


3/2 


3/2 


1.809 


K b 7 


0.1977 


5/8 


9/10 


7/6 


7/6 


7/5 


3/2 


1.809 



Table 1: The values of A^ ; and X&L of some complete hypergraphs K r n 



Remark: From the table above, we observe A^ = Amax for some complete hypergraphs. 
In fact, this is true for any complete hypergraph K r n . We point out the following fact 
without proofs. For an r-uniform hypergraph H and an integer s such that 1 < s < £, 

\{ S \H) = \£L(H) holds if and only if s = 1 and H is a 2-design. 



4 Properties of Laplacians 

In this section, we prove some properties of the Laplacians for hypergraphs. 
Lemma 2 For 1 < s < r/2, we have the following properties. 

1. The s-th Laplacian has (™)s! eigenvalues and all of them are in [0,2]. 

2. The number of eigenvalues is the number of connected components in G^ s ' . 

3. The Laplacian L^ s ' has an eigenvalue 2 if and only if r = 2s and G^ 8 ' has a bipartite 
component. 

Proof: Items 1 and 2 follow from the facts of the Laplacian of G^ S K If has an eigenvalue 
2, then G^ has a bipartite component T. We want to show r = 2s. Suppose r > 2s + 1. 
Let {i>o, ^2, ■ ■ ■ i v r-i} be an edge in T. For < i < 2s and < j < s — 1, let g{i,j) — is + j 
mod (2s + 1) and Xi = (v g uM, . . . , v g (.; jS _i)). Observe Xo,Xi,..., X2 S form an odd cycle in 
G^ . Contradiction. □ 
The following lemma compares A^ and Amax for different s. 
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Lemma 3 Suppose that H is an r-uniform hypergraph. We have 

Al 1) >Af ) >...>A^ /2J) ; (12) 

Arnax — ^max ^ • •• — ^max ^ . (13) 

Remark: We do not know whether similar inequalities hold for s > ^. 
Proof: Let T s be the diagonal matrix of degrees in G {s *> and i? (s) (/) be the Rayleigh quotient 
of C^l It suffices to show \{ s) < A^ _1) for 2 < s < r/2. Recall that A^ s) can be defined 
via the Rayleigh quotient, see equation ([2|). Pick a function / : V^— — — > R such that 
(/,T a _il) = and = R^~ l \f). We define g : -> R as follows 

<?(*) = /(a/), 

where a;' is a (s — l)-tuple consisting of the first (s — 1) coordinates of x with the same order 
in x. Applying equation llll we get 

(g,T s l) = d x ] 9{x) = E 9{x)d{x] y g * 

We have 

E^M*] = E E 9{x) 

x x F:[x]CF 

= E E (r-s + l)f(x') 

x 1 F:[x']CF 

= ^rf M (r-,s + l)/(x') 

x' 

- r-s + 1 ,_ x) 



Y /(x')4r 1] = o. 



( r ;-r)(«-i)!t 

Here the second last equality follows from equation [TT] and the last one follows from the 
choice of /. Therefore, 

J2 <?(*)4 S) = (r - « + 2)(r - s + 1) £ /(a/)^. 

a; a;' 

Thus (g,T s l) = 0. Similarly, we have 

£ 5 (x) 2 4 s > = ( r - , + 2)(r - * + 1) £ f&?d£- l) . 

x x' 

Putting them together, we obtain 

S(*) 2 4 S) = (r - « + 2)(r - * + 1) J2 /(^') 2 4'" 1) ■ 

a x' 

By the similar counting method, we have 

J2(g(x)-9(y))Mx,y) -EE bW-sfe)) 2 

= E E {r- S + l){r- S + 2){f(x')-f{y')f 

x'~y' F:[x']u[y']CF 

= (r- a + l)( r - a + 2 ) ^(/(ar')-/(y')) 2 M^2/')- 
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Thus, R (s) {g) = = A^ s 1} by the choice of /. As A^ s) is the infimum over all g, we 

get x[ s) < A^ 1} . 

The inequality (JT3J) can be proved in a similarly way. Since Amax is the supremum of the 
Raleigh quotient, the direction of inequalities are reversed. □ 

Lemma 4 For r /2 < s < r — 1, we have the following facts. 

1. The s-th Laplacian has eigenvalues and all of them are in [0,2]. 

2. The number of eigenvalues is the number of strongly connected components in D^ s ' . 

3. If 2 is an eigenvalue of L^ s \ then one of the s-connected components of H is bipartite. 
The proof is trivial and will be omitted. 

5 Applications 

We show some applications of Laplacians £W of hypergraphs in this section. 
5.1 The random s- walks on hypergraphs 

For < a < 1 and 1 < s < r/2, after restricting an a-lazy random s-walk on a hypergraph 
H to its stops (see section [3]), we get an a- lazy random walk on the corresponding weighted 
graph G^ S K Let tt(x) = da;/vol(V-) for any x £ V-, where d x is the degree of x in G« and 
vol(V-) is the volume of G^ s \ Applying theorem [TJ we have the following theorem. 

Theorem 9 For 1 < s < r/2, suppose that H is an s-connected r -uniform hypergraph H 
and A x (and AmLcj * s the first non-trivial (and the last) eigenvalue of the s-th Laplacian of 
H . For < a < 1, the joint distribution fk at the k-th stop of the a-lazy random walk at 
time k converges to the stationary distribution tt in probability. In particular, we have 

\\(f k ~7:)T-^\\<(\i s) ) k \\(f -7:)T^ 2 \\, 

where Xa^ — max{|l — (1 — a)A^ S '*|, |(1 — a) Amax — 1|, and /o is the probability distribution 
at the initial stop. 

For < a < 1 and r/2 < s < r — 1, when restricting an a-lazy random s-walk on a 
hypergraph H to its stops (see section 2), we get an a-lazy random walk on the corresponding 
directed graph 2)W. Let tt(x) = d x /vo\(V-) for any x £ V-, where d x is the degree of x in 
and vol(V-) is the volume of D^ s h Applying theorem[5j we have the following theorem. 

Theorem 10 For r/2 < s < r — 1, suppose that H is an s-connected r-uniform hypergraph 
and X\ is the first non-trivial eigenvalue of the s-th Laplacian of H . For < a < 1, the 
joint distribution f k at the k-th stop of the a-lazy random walk at time k converges to the 
stationary distribution -k in probability. In particular, we have 

\\{h-*)T- ll2 \\<(o-^) k \\{f -K)T-VX 



where o~u < y 1 — 2a(l — a)X 1 s , and fo is the probability distribution at the initial stop. 

Remark: The reason why we require < a < 1 in the case r/2 < s < r — 1 is 
cr (L> (s) ) = 1 for r/2 < s< r- 1. 



13 



5.2 The s-distances and s-diameters in hypergraphs 

Let H be an r-uniform hypergraph. For 1 < s < r — 1 and i,j/£ V-, the s-distance (x, y) 
is the minimum integer k such that there is an s-path of length k starting at x and ending 
at y. For X,Y C let d^(X,Y) = (x , y) \ x G X, y G Y}. If H is s-connected, 

then the s-diameter diam^-^if) satisfies 

diam (s) (ii) = max {S s) (x, y)}. 

x,y£LV— 

For 1 < s < |, the s-distances in if (and the s-diameter of H ) are simply the graph distances 
in GW (and the diameter of G^), respectively. Applying Theorem [2] and Corollary [T] we 
have the following theorems. 

Theorem 11 Suppose H is an r-uniform hypergraph. For integer s such that 1 < s < |, 
let A^ ('and Amaxj &e the first non-trivial (and the last) eigenvalue of the s-th Laplacian of 



H. Suppose A^L > X\ S) > 0. For X,Y C V*, ifd^(X,Y) > 2, the 



have 



d (s) (X,Y) < 



log 



vol(X)vol(r) 
vol(X)vol("K) 



loe 



iJere vol(*) are volumes in G^ s \ 



Remark: We know A^ > if and only if H is s-connected. The condition Amax > X\ 
holds unless s = 1 and every pair of vertices is covered by edges evenly (i.e., if is a 2-design). 

Theorem 12 Suppose H is an r-uniform hypergraph. For integer s such that 1 < s < ^, 
let Aj 8 ^ (and AmaxJ be the first non-trivial (and the last) eigenvalue of the s-th Laplacian of 

(s) (s) 

H . If Amax > X\ > 0, then the s-diameter of an r-uniform hypergraph H satisfies 



(«) 



diam {s) (H) < 



5W 



iiere vol(V-) = X^eVi^ — ^(if )| rfj^jj anc ^ <^ 15 '' *s i/ie minimum degree in CxW . 

When r/2 < s < r — 1, the s-distances in if (and the s-diameter of i?) is the directed 
distance in (and the diameter of respectively. Applying Theorem [5] and its 

remark, we have the following theorems. 

Theorem 13 Let H be an r-uniform hypergraph. For r/2 < s < r — 1 and X, Y C V~ ; if 

ii is s-connected, then we have 



d {s) {X,Y) < 



log 



vol(X)vol(y) 
vol(X)vol(F) 



log 



2-A 



iiere A^ is the first non-trivial eigenvalue of the Laplacian of D^ s \ and vol(*) are volumes 
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Theorem 14 For r/2 < s < r — 1, suppose that an r-uniform hypergraph H is s-connected. 
Let Xi be the smallest nonzero eigenvalue of the Laplacian of D^"K The s-diameter of H 
satisfies 

^2 logoff 



diam [s) {H) < 



log 



2-A 



Here vol(V-) = X^gv^ 6 ^ = l^(^)l r - an< ^ $ * s ^ e minimum degree in D^ s 



5.3 The edge expansions in hypergraphs 

In this subsection, we prove some results on the edge expansions in hypergraphs. 

Let H be an r-uniform hypergraph. For 5 C (^) , we recall that the volume of S satisfies 

vol(S) = £ d x . 
Here d x is the degree of the set x in H. In particular, we have 

The density e(S) of 5 is • Let 5 be the complement set of S in (^). We have 

e(S) = l-e(S). 



For l<i<s<r-i,SC (^) , and T C 



let 



T) = {f e : 3a; E S, 3y £ T, x n y = 0, andiUi/Cf}. 

Note that l-E^S 1 , T)\ counts the number of edges contains x U y for some x E S and y E T. 
Particularly, we have 



\E(H)\ 



s\t\(r -s-t)\ 



Theorem 15 For 1 < t < s < §, 5 C and T C Zei e(S,T) = [Jffi)ffiL - We 
have 



,(S, T) - e(S)e(T)\ < A« yj e(S)e(T)e(S)e(f). 



(14) 



Proof: Let be the weighed undirected graph defined in section [3J Define S' and T 1 
(sets of ordered s-tuples) as follows 

S' = {x e | [x] e 5}; 

r ' = {(y, z ) s V- | [y] e T}. 
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Let S' (or T') be the complement set of S' (or T') in V-, respectively. We make a convention 
that vol G e,(*) denotes volumes in while vol(*) denotes volumes H. We have 



vol G e)(G«) 
vol G (.)(5') 
voice, (T') 
vol G(s) (5') 
vol G(3 ,(T') 



vol 

vol(S) 
vol(T) 
vol(S) 
vol(T) 



s!(r — s)! 
(r-2s)!' 
s!(r — s)! 



(r- 


2a)! 


t\(r 


-*)! 


(r- 


2s)! 


s!(r 


-s)! 


(r- 


2s)! 


i!(r 


-t)! 


(r- 


2s)! 



(15) 
(16) 
(17) 
(18) 
(19) 



Let E G {.-, {S 1 , T) be the number of edges between S' and V in GK We get 

(r — s — itVs'il 
|S G w(5',T')| - (r -2s)! ^ (5 ' r)| - 

Applying Theorem [3] to the sets 5' and T" in G^, we obtain 

vol G(s) (5')vol G(s) (T') 



|£ G e>(S',T')|- 



vol G(s ,(G( s )) 



< A 



W Vvol G ( S ) (SQvolcc) (TQvoIgc) (g )vol G( .) (T 7 ) 
vol G(s ,(G( s )) 

Combining equations (jl5H19[) and the inequality above, we obtain inequality 1141 



□ 



Now we consider the case that s > |. Due to the fact that Oq = 1, we have to use the 



weaker expansion theorem [7] Note that 



E 



= \E(H)\- 



(20) 



(r- s-i)!s!t! 

We get the following theorem. 

Theorem 16 For 1 < t < § < s < s + f < r, S C Q, and T C Q, Zei e(S*,T) 
[g(7^T7^T)| ■ f l x ^ 2/1 ^ niin{£, 2s — r} /or any x 6 5 and y £T, then we have 

\±e(S,T) - e(5)e(T)| < X^y/e{S)e(T)e(S)e(T). 
Proof: Recall that is the directed graph defined in section [3l Let 

s' = {x e | [x] e s}-, 

T' = {(y,z)€V^| [z]eT}. 

We also denote S' (or T") be the complement set of S' (or T") in V-, respectively. We use 
the convention that vol D < S )(*) denotes the volumes in while vol(*) denotes the volumes 
in the hypergraph H. We have 



vol D(s) ( J D (s) ) = vol 



s!(r — s)!; 



vol £) ( S )(S'') 
vol e,(T') 
vol DW (5') 
vol DW (T') 



vol(S*)s!(r - s)!; 
vol(T)t!(r - *)!; 
vol(S)«!(r - a)!; 
vol(T)s!(r - s)!. 



(21) 

(22) 
(23) 
(24) 
(25) 
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Let E DM (S', T") (or E D(s) (T', S')) be the number of directed edges from S' to T ( or from 
T to S') in F», respectively. We get 

\E DM (S',T')\ = (r-s-t)[s\t\\E(S,T)\. 

From the condition \x f~l y\ 7^ min{i, 2s — r} for each x € S and each y £ T, we observe 

£ D(s) (T',S')=0. 

Applying Theorem [7] to the sets S" and T' in F/ s ), we obtain 

\E D(s) (S',T>)\ + \E DW (T',S')\ vol DM (S')vo\ ms) (T) 



< X ( S ) a/vo1 j( .) (SOvoljo (TQvdIjc) (Spvoljo (F 7 ) 
" 1 voLj (s >(.D«) 

Combining equations (|2HI25[) and the inequality above, we get inequality [201 O 

Nevertheless, we have the following strong edge expansion theorem for § < s < r — 1. 
For 5, T C ( ) , let F^S 1 , T) be the set of edges of the form x U y for some x € 5 and y e T. 
Namely, 

E'(5 5 T) = {F G F(F) I 3a; G 5, 3y e T, F = x U y}. 



Observe that 



= \E(H)\ 



(r - s)!(2s - r)!(r - s)! 



Theorem 17 For § < s < r - 1 and S,T C /e£ e'(S*,F) = j^T^pjyy • We have 

\e'(S, T) - e(S)e(T)\ < A« ^/ e(S)e(T)e(S)e(f). (26) 

Proof: Let 

S' = {x G I [x] G 5}; 

T' = {y e I [y[G T}. 

Let S' (or X") be the complement set of S' (or T' respectively) in V-. We use the conven- 
tion that vol£,(a)(*) denotes the volumes in F/ s ) while vol(*) denotes the volumes in the 
hypergraph H. We have 



vol D(s ,(F/ s >) = volMjJs!(r-a)!; (27) 

vol D(s) (S") = vol(5)s!(r-s)!; (28) 

vobj< s) (T') = vol(T)sl(r - s)\; (29) 

vol DW (5') = vol(5)s!(r - «)!; (30) 

vol DW (T') = vol(f)a!(r - a)!. (31) 



Let F D( a) (S',T') (or F £ , (s) (T', 5')) be the number of directed edges from S" to T ( or from 
T' to S') in F», respectively We get 

\E DW (S\ T')\ = |F D(S) (F, S")| = (r - s)\{2s - r)!(r - S )!|F'(S, T)\. 
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Applying Theorem [7] to the sets S' and T' on D^ s \ we obtain 



\E DM (S',T')\ + \E DW (T',S')\ vol D(s )(y)vol g(s) (r) 
2 vol^wpW) 
< ^( S ) ^volpo (SOvoljo (TQvoljc) (5Qvol g(3 ) (TQ 
" 1 vol D( .) (£>(«)) 

Combining equations (I27H31[) and the inequality above, we get inequality □ 



6 Concluding Remarks 

In this paper, we introduced a set of Laplacians for r- uniform hypergraphs. For 1 < s < r— 1, 
the s-Laplacian is derived from the random s- walks on hypergraphs. For 1 < s < |, 
the s-th Laplacian is defined to be the Laplacian of the corresponding weighted graph 
(jW. The first Laplacian is exactly the Laplacian introduced by Rodriguez [9]. 

For | < s < r — 1, the is defined to be the Laplacian of the corresponding Eulerian 
directed graph . At first glimpse, cro(-D^) might be a good parameter. However, it 
is not hard to show that <7o(-D ( ' s ' ) ) = 1 always holds, which makes Theorem [6] useless for 
hypergraphs. We can use weaker Theorem [7] for hypergraphs. Our work is based on (with 
some improvements) Chung's recent work 18] on directed graphs. 

Let us recall Chung's definition of Laplacians [3] for regular hypergraphs. An r-uniform 
hypergraph H is <i-regular if d x — d for every x € V^— !-. Let G be a graph on the vertex set 
yr-i_ p Qr v^— !-, let xy be an edge if x = X1X2, . . . , x r _i and y = 2/1X2, . . . , x r _i such 
that {xi,yi,X2, ■ ■ ■ ,x r -\} is an edge of H. Let A be the adjacency matrix of G, T be the 
diagonal matrix of degrees in G, and K be the adjacency matrix of the complete graph on 
the edge set V^— !-. Chung [3] defined the Laplacian C such that 

C = T-A+-(K + (r-l)I). 

n 

This definition comes from the homology theory of hypergraphs. Firstly, C is not normalized 
in Chung's definition, i.e., the eigenvalues are not in the interval [0,2]. Secondly, the add- 
on term —{K + (r — 1)/) is not related to the structures of H. If we ignore the add-on 
term and normalize the matrix, we essentially get the Laplacian of the graph G. Note G is 
disconnected, then \\{G) = and it is not interesting. Thus Chung added the additional 
term. The graph G is actually very closed to our Eulerian directed graph _D( r-1 ). Let B be 
the adjacency matrix of Z?( r_1 ) . In fact we have B = QA, where Q is a rotation which maps 
x = Xi, X2 • ■ • , x r -i to x' = X2 ■ ■ ■ , x r —\, x\. Since d x = d X ', Q and T commute, we have 

(T-y2 BT -l/2y^ T -l/2 B rp-l/2\ _ T -l/2 B i T -l BT -l/2 

= T~ 1/2 A'Q'T~ 1 QAT~ 1/2 
= T- 1/2 A'T- l Q'QAT- 1/2 

Here we use the fact Q'Q = I. This identity means that the singular values of I — £,( r ~ is > is 
precisely equal to 1 minus the Laplacian eigenvalues of the graph G. 

Our definitions of Laplacians are clearly related to the quasi-randomness of hyper- 
graphs. We are very interested in this direction. Many concepts such as the s-walk, the 
s-path, the s-distance, and the s-diameter, have their independent interest. 
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